Ensemble classification by critic-driven combining
نویسندگان
چکیده
We develop new rules for combining estimates obtained from each classi er in an ensemble. A variety of combination techniques have been previously suggested, including averaging probability estimates, as well as hard voting schemes. We introduce a critic associated with each classi er, whose objective is to predict the classi er's errors. Since the critic only tackles a two-class problem, its predictions are generally more reliable than those of the classi er, and thus can be used as the basis for our suggested improved combination rules. While previous techniques are only e ective when the individual classi er error rate is p < 0:5, the new approach is successful, as proved under an independence assumption, even when this condition is violated { in particular, so long as p + q < 1, with q the critic's error rate. More generally, critic-driven combining achieves consistent, substantial performance improvement over alternative methods, on a number of benchmark data sets.
منابع مشابه
On Adaptive Confidences for Critic-Driven Classifier Combining
When combining classifiers in order to improve the classification accuracy, precise estimation of the reliability of each member classifier can be very beneficial. One approach for estimating how confident we can be in the member classifiers’ results being correct is to use specialized critics to evaluate the classifiers’ performances. We introduce an adaptive, critic-based confidence evaluatio...
متن کاملCombining Classifier Guided by Semi-Supervision
The article suggests an algorithm for regular classifier ensemble methodology. The proposed methodology is based on possibilistic aggregation to classify samples. The argued method optimizes an objective function that combines environment recognition, multi-criteria aggregation term and a learning term. The optimization aims at learning backgrounds as solid clusters in subspaces of the high...
متن کاملOptimum Ensemble Classification for Fully Polarimetric SAR Data Using Global-Local Classification Approach
In this paper, a proposed ensemble classification for fully polarimetric synthetic aperture radar (PolSAR) data using a global-local classification approach is presented. In the first step, to perform the global classification, the training feature space is divided into a specified number of clusters. In the next step to carry out the local classification over each of these clusters, which cont...
متن کاملCombining Classifier Guided by Semi-Supervision
The article suggests an algorithm for regular classifier ensemble methodology. The proposed methodology is based on possibilistic aggregation to classify samples. The argued method optimizes an objective function that combines environment recognition, multi-criteria aggregation term and a learning term. The optimization aims at learning backgrounds as solid clusters in subspaces of the high...
متن کامل